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Abstract This paper is devoted to the off- line multiple change- 
point detection in a semiparametric framework. The time series is 
supposed to belong to a large class of models including AR(co), 
ARCH(oo), TARCH(co),... models where the coefficients change at 
each instant of breaks. The different unknown parameters (num- 
ber of changes, change dates and parameters of successive models) 
are estimated using a penalized contrast built on conditional quasi- 
likelihood. Under Lipshitzian conditions on the model, the consis- 
tency of the estimator is proved when the moment order r of the 
process satisfies r > 2. If r > 4, the same convergence rates for the 
estimators than in the case of independent random variables are ob- 
tained. The particular cases of AR(oo), ARCH(oo) and TARCH(oo) 
■ show that our method notably improves the existing results. 
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1. Introduction. The problem of the detection of change-points is a classical problem as well 
| as in the statistic than in the signal processing community. If the first important result in this 
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topic was obtained by Page [20J in 1955, real advances have been done in the seventies, notably 
with the results of Hinkley (see for instance Hinkley [13]) and the topic of change detection became 
a distinct and important field of the statistic since the eighties (see the book of Basseville and 
Nikiforov [3] for a large overview). 

Two approaches are generally considered for solving a problem of change detection: an 'on-line' 
approach leading to sequential estimation and an 'off-line' approach which arises when the series 
of observations is complete. Concerning this last approach, numerous results were obtained for 
independent random variables in a parametric frame (see for instance Bai and Perron pjj. The 
case of the off-line detection of multiple change-points in a parametric or semiparametric frame for 
dependent variables or time series also provided an important literature. The present paper is a 
new contribution to this problem. 

In this paper, we consider a general class Mt(M, f) of causal (non-anticipative) time series. Let 
M and / be a measurable functions such that for all (xi)jgjv £ 1R , M((xj)j g jv) is a (m x p) 
non-zero real matrix and /((aJi)ieiv) £ IR™. Let TcZ and (£<)<ez be a sequence of centered inde- 
pendent and identically distributed (iid) R p -random vectors called the innovations and satisfying 
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var(£o) = Ip (the identity matrix of dimension p). Then, define 

Class A4t(M, /): The process X = (X t )tez belongs to A4t(M, /) if it satisfies the relation: 

(1.1) X t+1 = M((AV^ e w)6 + f{(X t ^) ie]N ) for all t G T. 

The existence and properties of these general affine processes were studied in Bardet and Winten- 
berger [2] as a particular case of chains with infinite memory considered in Doukhan and Win- 
tenberger [8j. Numerous classical real valued time series are included in A4z(M, f): for instance 
AR(oo), ARCH(oo), TARCH(oo), ARMA-GARCH or bilinear processes. 

The problem of change-point detection is the following: assume that a trajectory (Xi,--- ,X n ) 
of X = (Xt)teZ is observed where 

(1.2) X G M T ; {M e * , f e * ) for all j = 1, . . . , K*, with 

• K* G IN*, T* = + 1, 1*_ x + 2, . . . , t*} with <q< ... < t^._! < n, t* G IV and by 

convention = — oo and t* K * = oo; 
. 9* = (e* j V ■ ■ ■ ,0* d ) G © C M d for j = 1, . . . , K*. 

The aim in the problem is the estimation of the unknown parameters (K*, (ij)i<j<if*-i, (Qj)i<j<K*)- 
In the literature it is generally supposed that A is a stationary process on each set T* and is in- 
dependent on each T? from the other T£, k ^ j (for instance in |18| . |15| . [6] and [?])■ Here the 
problem (|1.2|) does not induce such assumption and thus the framework is closer to the applications, 
see Remark 1 in [7]. 

In the problem of change-point detection, numerous papers were devoted to the CUSUM pro- 
cedure (see for instance Kokozska and Leipus [15] in the specific case of ARCH(oo) processes). In 
Lavielle and Ludena [17] a "Whittle" contrast is used for estimating the break dates in the spectral 
density of piecewise long- memory processes (in a semi-parametric framework). Davis et al. [6] 
proposed a likelihood ratio as the estimator of break points for an AH(p) process. Lavielle and 
Moulines [18] consider a general contrast using the mean square errors for estimating the param- 
eters. In Davis et al. [7J, the criteria called Minimum Description Length (MDL) is applied to a 
large class of nonlinear time-series model. 

We consider here a semiparametric estimator based on a penalized contrast using the quasi- 
likelihood function. For usual stationary time series, the conditional quasi-likelihood is constructed 
as follow: 

1. Compute the conditional likelihood (with respect to u{Xq,X-\, . . .}) as if (X t )t<=z is known 
and when the process of innovations is a Gaussian sequence; 

2. Approximate this computation for a sample (X%, . . . ,X n ); 

3. Apply this approximation even if the process of innovations is not a Gaussian sequence. 
The quasi-maximum likelihood estimator (QMLE) obtained by maximizing the quasi-likelihood 

A.„„j.; 1„„„ „„ ; ; „ -,„j-„j-; . j-:„„;„ aU„ „„„„ „tn »nnn „„„„ ^„„„ T j-1 ITT1 
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Berkes et al. [4|, Franck and Zakoian or generalizations of GARCH processes (see Mikosch and 
Straumann [23], Robinson and Zaffaroni |22j). Bardet and Wintenberger [2] study the asymptotic 
normality of the QMLE of 9 applied to Mz(fg, Mq). Thus, when K* is known, a natural estimator 
of the parameter ((tj)i<j<K*-i, (6j)i<j<K*) for a process satisfying (jl.2p is the QMLE on every 
intervals [tj + 1, . . . , ij+i] and every parameters 9j for 1 < j < K*. However we consider here 
that K* is unknown and such method cannot be directly used. The solution chosen is to penalize 
the contrast by an additional term f3 n K, where (/3 n ) ne ^v is an increasing sequence of real numbers 
(see the final expression of the penalized contrast in (|3.2p ). Such procedure of penalization was 
previously used for instance by Yao [23] to estimate the number of change-points with the Schwarz 
criterion and by Lavielle and Moulines [18] . Hence the minimization of the penalized contrast leads 
to an estimator (see (|3.3j) ) of the parameters (K*, (t*)i<j<^*_i, (9* )i<j<K*) ■ 
Classical heuristics such as the BIC one or the MDL one of [7\ lead to choose f3 n oc logn. In our 
study, such penalizations are excluded in some cases, when the models M.t{M, f) are very depen- 
dent of their whole past, see Remark 13.31 for more details. Finally, we will show that an "optimal" 
penalization is (3 n cx y/n which overpenalizes the number of breaks to avoid artificial breaks in cases 
of models very dependent of their whole past (see Remark [33]) . 

The main results of the paper are the following: under Lipshitzian condition on fg and Mq, the 
estimator (K n , (tj/ n )i < j < j( _ 15 (@j)i<j<K ) * s consistent when the moment of order r on the inno- 
vations and X is larger than 2. If moreover Lipshitzian conditions are satisfied by the derivatives 
of fg and Mq and if r > 4, then the convergence rate of (tj/ n )i<j<K -l * s Op{ n ~ l ) and a Central 
Limit Theorem (CLT) for (0j)i<j - <k (with a \/n-convergence rate) is established. These results 
are "optimal" in the sense that they are the same than in an independent setting. 

Section [2] is devoted to the presentation of the model and the assumptions and the study of the 
existence of a nonstationary solution of the problem (|1.2|) . The definition of the estimator and its 
asymptotic properties are studied in Section [3j The particular examples of AR(oo), ARCH(oo) and 
TARCH(oo) processes are detailed in Section [H Section [5] contains the main proofs. 

2. Assumptions and existence of a solution of the change process. 

2.1. Assumptions on the class of models Mz(fg, Mq). Let 9 £ M d and Mg and fg be numerical 
functions such that for all (xi)igjv £ B K , Me((xj)j e jv) / and /e((xj)j e jv) £ JR- We use the 
following different norms: 

1. || • || applied to a vector denotes the Euclidean norm of the vector; 

2. for any compact set C M d and for any g : — > M d ; ||g||e = su P6»ee(ll5'(^)ll); 

3. for all x = (x±, ■ ■ ■ , xk ) G K , \\x\\ m = max |xj|; 

i=X,— ,K 

4. if X is JR p -random variable with r > 1 order moment, we set ||A|| r = (iBllXll 7 *) 1 / 1 ". 
Let ^q = fg, Mg and i = 0, 1, 2, then for any compact set C M d , define 
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Assumption Ai(^g,Q): Assume that \\d l ^fg(0)/d9 l \\Q < oo and there exists a sequence of non- 
negative real number (a\ k \^g, @))i>i such that Yl a k 0^0)®) < 00 satisfying 

k=l 



d9 l d9 i 



00 

< ^a«(^,G)|x fc - y k \ for all x,y G . 



6 fe =i 



In the sequel we refer to the particular case called "ARCH- type process" if fg = and if the 
following assumption holds on hg = M|: 

Assumption Aj(/i#,0): Assume that \\d t hg{§) / d9 l \\Q < 00 and there exists a sequence of non- 
negative real number (a\ k \hg, 0))i>i such as a k fog,®) < °° satisfying 



k=l 

d%(x) d'heiy) 



00 

„(*) 



< Y,n { k( h e,®)\4 ~ vl\ for all x, ye 





fe=i 



de 1 de i 

Now, for any i = 0, 1,2 and G 0, under Assumptions Ai(fg, 0) and Ai(Mg, 0), denote: 



(2.1) 00(0) := £^(0) where := a^/j.M) + (lE\Zo\ r ) 1/r $ (Mg, {6}), 

k>l 

and under Assumption Ai(hg,Q) 



(2.2) ^(0)1=^2^(0) where /f } (0) := (^oH 2 /^ (hg, {6}). 



3®(q\ whprp fl.Wrm •= (jFA^m 2 ^^! 

k>\ 

The dependence with respect to r of /3^' ) (9) and /3^\9) are omitted for notational convenience. 
Then define: 

(2.3) 0(r) := {0 G 0, A (/ e ,{#}) and A)(M , {0}) hold with^ ^) < 1} 

U{# G fg = andA)(^,OT) holds with/3 (0) (#) < 1}. 

From [2 [ we have: 

Proposition 2.1 If 9 £ 0(r) /or some r > 1, there exists a unique causal (non anticipative, i.e. 
Xt is independent of (£j)j>t for t G "L) solution X = (Xt)tei G Mz(fe, Mg) which is stationary, 
ergodic and satisfies ||Ao|| r < 00. 

Remark 2.1 The Lipschitz-type hypothesis Ai(^g,Q) are classical when studying the existence of 
solution of general models. For instance, Duflo used such a Lipschitz-type inequality to show the 
existence of Markov chains. The subset 0(r) is defined as a reunion to consider accurately general 
causal models and ARCH-type models simultaneously: for ARCH-type models Ao(hg,{9}) is less 
restrictive than Aq(Mq, {9}). However, remark that Ao(hg, {9}) is still not optimal for ensuring 
the existence of a stationary solution for ARCH-type models. 

Let 9 G 0(r) and X = (X t )t<=z a stationary solution included in Ai%(fg, Mg). For studying QMLE 
properties, it is convenient to assume the following assumptions: 
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Assumption ld(0): For all 9,9' G 6 2 , 
[f g {X ,X_ Xt ■■■) = fe>{X Q ,X_ x , • • • ) and h e {X Q ,X_ x , ■■■) = hg.{X ,X. Xt ■■■) a.s.) 



= 6'. 



Assumption Var(@): For all 9 € G, 




/ or 



Ki<d 



/ a.s. 



Assumption D(O) will be required to define the QMLE, Id(@) to show the consistence of the QMLE 
and Var(0) to show the asymptotic normality. 

2.2. Existence of the solution to the problem (II. 2D . Consider the problem (II. 2p and let (Xi, . . . , X n ) 
be an observed path of X. Then the past of X before the time t = depends on 9\ and the future 
after t = n depends on 9* K ,. The number K* — 1 of breaks, the instants t\, ■ ■ ■ , of breaks and 
parameters 91, ■ ■ ■ , 9* K * are unknown. Consider first the following notation. 



• For K G IV* and t G Tk, T k = {t G Z, t^i < t < tk} and = CardiT^) with 
1 < k < K. In particular; T* = {t G Z, t*_ x < t < t*} and n* = Card(T*) for 
1<J<K*. For alll<k<K and 1 < j < K* , let n kj = Card(T* n T k ); 

The following proposition establishes the existence of the nonstationary solution of the prob- 
lem (ll.2p and its moments properties. 

Proposition 2.2 Consider the problem (11.21) . Assume there exists r > 1 such that 9* G 6(r) 
for allj = 1,...,K*. Then 

(i) there exists a process X = [X t )t& solution of the model fll.2j) such as \\X t \\ r < oo for 
t G Z and X is a causal time series. 

(ii) there exists a constant C > such that for all t G Z we have \\X t \\ r < C. 

Remark 2.2 The problem (11.21) distinguishes the case t G T* = {1, . . . , t*} to the other ones 
since it is easy to see that (X t ) teT * is a stationary process while (X t ) t>t * is not. However, all 
the results of this paper hold if (X t )teT* is defined as the other (X t )teT*, 3 ' > 2 (by defining 
a break in t = 0) or, for instance, if we set X t = for t < 0. 

3. Asymptotic results of the estimation procedure. 

3.1. The estimation procedure. The estimation procedure of the number of breaks K* — 1, 
the instants of breaks t* and the parameters 9* is based on the minimum of a penalized 



Notation. 



• For K > 2, Tk = {t = {ti, ■ ■ ■ tic-i) \ < t\ < . . . < tx-i < n\. In particular, 
t* = (tl, . . . , G Tk* is the true vector of instants of change; 
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T = {t,t + 1, . . . ,t'}, the distribution of X s \ (X s ^j) je]N * is J\f(f (X s _i, . . .),hg(X s _i, •••)). 
Therefore, with the notation fjj = f e (X s _ 1; X s _ 2 . . . ), M| = M e (X s _ 1; X s _ 2 . . . ) and h s e = 
Mg 2 , we deduce the conditional log-likelihood on T (up to an additional constant) 

L n (T, 6) := -~ 1s(d) with q s (9) := {X ' ~ fS) * + log (/# . 
seT e 

By convention, we set L n ($,9 k ) := 0. Since only Xi, . . . ,X n are observed, L n (T,9) cannot 
be computed because it depends on the past values (X_j) je jv We approximate it by: 

L n (T,0):=~J2q s (e) where g.(g) := ^ ~ ^ + log (Kg) 

with ^ = / fl (X t _ l5 . . . , Xl, u) , M| = M e (X t _ u ...,X 1 ,u) and fc* = (Ml) 2 for any determin- 
istic sequence u = (u n ) with finitely many non-zero values. 

Remark 3.1 For convenience, in the sequel we chose u = (w n ) ng N with u n = for alln G N 
as in rO] / or m |IJ/. Indeed, this choice has no effect on the asymptotic behavior of estimators. 

Now, even if the process (£t)t is non-Gaussian and for any number of breaks K — 1 > 1 and 
any t G J 7 ^, # G B(r)- ff , define the contrast function J n by the expression: 

K K K* 

(3.1) J n (K,t,6) := -2Y,L n (T k ,6 k ) = -2 ^ ^ L n (T fc n T*, fc ), 

fc=i fc=i j=i 

Finally, let (f„)neiv an d (/3 n ) n ew be sequences satisfying t>„ > 1 and (3 n := n/v n —> oo 
(n -»■ oo). Let A max G W* and for K G {1, ■ • • , A max } and (t,0) G J> x 6(r) x (6(r) is 
supposed to be a compact set) define the penalized contrast J n by 

(3.2) J n (K,t,9) := J n (K,t,6) + — K = J n (K , t, 6) + (5 n K 

V n 

and the penalized contrast estimator (K n: t n ,9 n ) of (A*, £*,#*) as 

(3.3) (A\,? n ,?J = Argmin Argmin (J n (K,t,6)) and r n = =2 

i</r<.fi: m ax (M)e-^A-xe(r)^ n 

For AT > 1 and i G J 7 ^, denote ? n (t) = (0(7i), . . . , 0(T K )) := Argmin ( J„(i, 0)) = Argmin ( J n (t, 0)) . 

Then, 6 n (T k ) is the QMLE of 6* k computed on T k and 6_ n (t*) is the QMLE of 0*. 

Remark 3.2 //A* is known, the estimator o/(r*,£*) may fre obtained by minimizing J n in- 
stead of J n . However the knowledge of K* does not improve the asymptotic results established 
in this paper. 
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3.2. Consistency of (K n ,t n ,6 n ). For establishing the consistency, we add the couple of fol- 
lowing classical assumptions in the problem of break detection: 

Hypothesis B: min II — 9*\\ > 0. 

j=l,-,K*-l J+ 3 

Furthermore, the distance between instants of breaks cannot be too small: 

Hypothesis C: there exists r*, . . . , r| r *_ 1 with < r* < . . . < Tj <t _ l < 1 such that for 
j — 1, • • • , K* , t* = [nTj] (where [x] is the floor of x). The vector r* = (r*, . . . , r^ r »_ 1 ) is 
called the vector of breaks. 

Even if the length of T* has asymptotically the same order than n, the dependences with 
respect to n of t*, tk, T* and are omitted for notational convenience. 
Finally we make a technical non classical assumption. Using the convention: if Ai(Mg,Q) 
holds then af\hg, 9) = and if Ai(hg, 6) holds then (Me, 6) = 0, define: 

Hypothesis Hj (i = 0,1,2): For < p < i, the assumptions A p (f g ,Q), A p (M e ,Q) (or 
A p (hg, 0) ) hold and for all j = 1, . . . , K* there exists r > 1 such that 6* G @(r). Denoting 

c* = min J-log(/3 (0) (#*))/8) A min ^ ( - log(/3 (0) (fl*))/8) 
t/te sequence (v n ) n( z]N used in ( 13.21) satisfies for all j = 1, • ■ ■ i^*: 

(3-4) £Gff A1 (£ ft (0, W)) r AE(f) r/4A, (E ^>)<°° ^ 

fc>l £>fcc*/log(fc) Ai>1 l>kc*/\og{k) 

Ed)^ 1 ! E («? ) (/„©W) + «? ) (M e ,e(r)) + a? ) (/ ie ,e(r)))) < 4 oo. 

fc>i e>k/2 

The assumption Hj is interesting as it links the decrease rate of the Lipschitz coefficients 
and the penalization term of (13.21) . The classical BIC penalization and the one coming from 
the MDL approach (see [7]) correspond to a sequence v n oc n/ log(n). This choice is possible 
if the Lipschitz coefficients decrease exponentially fast, which hold for all models M(fg, Mg) 
with finite order (see Remark below). However, if the decrease of the Lipschitz coefficients 
is slower, our method can exclude such a choice and an heavier term (3 n = n/v n » log(n) 
in the penalization has to be chosen. 

Remark 3.3 Conditions (13.41) satisfied by {v n ) n are deduced from a result of Kounias [16]. 
The conditions on (v n ) n are not too restrictive: 

(1) geometric case: if af(f e ,Q{r))+af(M e ,®(r))+af(h ,®(r)) = 0{a l ) withO <a<l, 
then any (v n ) n such as v n = o(n) can be chosen (for instance v n = n(\ogn)~ l ) . 
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• if -y > 1 + (1 V4r _1 ), then all sequence (v n ) n such as v n = o{n) can be chosen (for 
instance v n = ra(logn) -1 ). 

• iflVAr' 1 < 7 < 1 + (1 V^" 1 ), then any (v n ) n such as v n = 0(n^( lv4r_1 )(logn)^) 
with 5 > 1 V 4r _1 can be chosen. 

We are now ready to prove the consistency of the penalized QMLE: 

Theorem 3.1 Assume that the hypothesis D(Q(r)), Id(Q(r)), B, C and H Q are satisfied 
with r > 2 and v n — > oo . // K max > K* then: 

(3.5) (K n ,r n ln) ^ (K\r*,9*). 

Remark 3.4 If K* is known, we can relax the assumptions for the consistency by taking 
v n = 1 for all n as the penalization term in (13.21) does not matter. If K* is unknown then 
a reasonable choice in any geometric or Riemanian cases is v n oc logn (therefore (3 n oc 
nilogn)' 1 ), see Remark \3lk 

3.3. Rate of convergence of the estimators. To state a rate of convergence of the estimators 
X_ n and 9 n , we need to work under stronger moment and regularity assumptions. 

Theorem 3.2 Assume that the hypothesis D(Q(r)), Id(Q(r)), B, C and H 2 are satisfied 
with r > 4 and v n — > oo. If K max > K* then the sequence (\\t n — t*|| m )„>i is uniformly tight 
in probability, i.e. 

(3.6) lim lim F(\ft n -t* \\ m > 5) = 0. 

S — > oo n — ¥oo 

This theorem induces that w~ l \\t n — t*\\ m A for any sequence (w n ) n such as w n — > oo 
and therefore ||t„ — t*\\ m = o P {w n ): the convergence rate is arbitrary close to Op(l). This 
is the same convergence rate as in the case where {X t ) t is a sequence of independent r.v. 
(see for instance [1]). Such convergence rate was already reached for mixing processes in [18j. 

Let us turn now the convergence rate of the estimator of parameters 9*. By convention 
if K n <K\ set Tj = f Rn for j e {K n , . . . , K*}. Then, 

Theorem 3.3 Assume that the hypothesis D(Q(r)), Id(Q(r)), B, C and H2 are satisfied 

o 

with r > 4 and y/n = 0(v n ). Then if 9* 6 G(r) for all j = 1, • • ■ , K* , we have 

(3.7) ^ (e n (fj) - 9*) A M d (0, F(9*y 1 G(9*)F(9*)- 1 ) , 
where, using q j defined in f 1 5 . 2 [) . the matrix F and G are such as 

(3.8) (Fm) tl = E( 9 yP) and (G(«J)) tl = B f%ffi%M). 
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Remark 3.5 In Theorem Iff. 31 a condition on the rate of convergence of v n is added. The 
optimal choice for the penalization term corresponds to v n oc sjn as it corresponds to the most 
general problem (ll.2p . see Remark \3.3[ However, by assumption H2 it excludes models with 
finite moments r > 4 satisfying: £~ 7 = 0(a^\fg, 9(r)) + a^(Mg, 6(r)) + a^\h g , 0(r))) 
with 1 < 7 < 3/2 /or some z = 0,1,2. For these models the consistency and the rate of 
convergence of order n for r n hold but we do not get any rate of convergence for 6_ n . 

4. Some examples. 

4.1. AR(oo) models. Consider AR(oo) with K* — 1 breaks defined by the equation: 

x t = M^Xt-k + 6 , t*_, < t < t* , j = 1, ■ ■ • , k*. 

k>l 

It correponds to the problem ( II. 2p with models M.T*{fe^ Mg) where fg(xi, ■ ■ ■ ) = J2k>i 4>k{6)xk 
and M 9 = 1. Assume that 6 is a compact set such that ^2 k>1 ||0fc(#)||e < 1- Thus 0(r) = 6 
for any r > 1 satisfying -ZE|£o| r < 00 ■ Then Assumptions D(9) and A (fg, 0) hold automat- 
ically with h= 1 and aj: 0) (,/ e , 0(r)) = ||0 fc (0)||e- Then, 

• Assume that Id(O) holds and that there exists r > 2 such that IE\^ \ r < 00. If there 
exists 7 > 1 V 4r _1 such that ||0 fc (6 l )||e = Oik' 1 ) for all k > 1, then the penalization 
v n = logn (or (3 n = n/logn) ensures the consistency of (K n} 9 n} 6_ n ). 

• Moreover, if r > 4, 7 > 3/2 and 4>k twice differentiable satisfying ||</4(#)||e = 0(/c -7 ) 
and ||</>fc(^)||e — 0(A;~ 7 ), then the penalization v n — j3 n — y/n ensures the convergence 
(13TB]) of T n and the CLT ([32D satisfied by ? n (Ty) for all j. 

Note that this problem of change detection was considered by Davis et al. in [B] under 
moments of order greater than 4 is required. In Davis et al. [7], the same problem for 
another break model for AR processes is studied. However, in both these papers, the process 
is supposed to be independent from one block to another and stationary on each block. 

4.2. ARCH(oo) models. Consider an ARCH(oo) model with K* — 1 breaks defined by: 

00 1/2 
x t = [mo*) + MfyXt-k) 6 , t*_, < t < t* , j = 1, • • • , K*, 
k=l 

where for any 9 G 0, tpo(6) > and (ipk{@))k>i is a sequence of positive real number and 
iE(£o) = 1- Note that hg((xk)ken) — V ; o(^) + J2T=i ^k(0)x1 an d fe = 0. Assume that is a 
compact set such that J2 k>1 11^(0) He < 1, then 0(2) = 0. Assume that inf^e ip^iO) > 
which ensures that _D(0) and Id(Q) hold. 

• If there exists 7 > 2 such that ||^fc(6 l )||e = 0(&T 7 ) for all k > 1, then the penalization 
v n = logn (or f3 n = n/logn) leads to the consistency of (K n ,9 n ,9 n ) when 6* G for 
all j. 
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• Moreover, if r > 4 and ipk is twice differentiable satisfying H^feWII© = ^(k 7 ) and 
||^(0)||e = Oik'"') with 7 > 3/2, if 6(4) is a compact such that 9* G 0(4) for all j, 
then the penalization v n = (3 n = \fri as in Remark I3T31 ensures the convergence (13.61) of 
t n and the CLT (13.71) satisfied by 9 n (Tj) for all j. 

This problem of break detection was already studied by Kokoszka and Leipus in [15J but 
they obtained the consistency of their procedure under stronger assumptions. 

Example 1 Let us detail the GARCH(p, q) model with K* — 1 breaks defined by: 

q p 

X t = a t £ t , a 2 t = a* 0sj + ]T a* k>j Xl k + ]T b^al, t*_, < t < t* , j = 1, • • • , K* 

k=l k=l 

with IE{^q) = 1. Assume that for any 9 = (oq, . . . , a q , bi, . . . , b p ) G @ then > 0, b^ > and 
Y^=i^k < 1- Then, there exists (see Nelson and Cao \W$ ) a nonnegative sequence {ipk{d))k 
such that of = 4 ) ${9) + 'Yl l k>i ^Pki^^t-k- Remark that this sequence is twice differentiable with 
respect to 9 and that its derivatives are exponentially decreasing. Moreover for any 9 G it 
holds J2k>i^k(d) < {J2l=i a k)/(l - J2l=ih) and one can consider: 

0(r) = I 9 G , [lEM) 2/r E ak + fl bk < 1 \ ■ 
L k=i fe=i J 

Then if J2l=i a t,j + Y^k=i K,j < 1 f or a ^ 3 (case r > 2), our estimation procedure as- 
sociated with a penalization term j3 n K for any 1 << (3 n << n is consistent. Moreover, 
if (iE|£ | 4 ) 1//2 2~2l=i a t,j + 2~2k=i K,j < 1 f or a ^ h then our procedure with a penalization 
1 << j3 n = 0(\/n) allows the same rates of convergence than in the case where (X t ) are 
independent r.v. For example, a penalization j3 n oc logn as in [1] can be chosen in this case. 

4.3. Estimates breaks in TARCH(oo) model. Consider a TARCH(oo) model with breaks 
defined by: 

X t = o-ttt , <r t = b (9*) + £ (&+(0*)max(X t _ fe , 0) - b^(9*)mm(X t „ k , 0)) , 

fc>i 

for any t*_ x <t<t*, j = 1, • • • , K* and where J2k>i max (\\bt (^)lle, \\b~k~ (#)||e) < 00. Then 
fe = and (A o (M ,0)) holds with af{M e ,Q) = max(||6+(0)|| e , \\K{9)\\ e ). 

• Assume ||f || r Yuh>x max (ll & fc Wile, \\b k {9)\\e) < 1 for r > 2. If there exists 7 > 1 V4r _1 
such as maxdl&^^He, \\b k {9) ||e) = 0(/c~ 7 ) for all k > 1, then a penalization v n = logn 
(or (3 n = n/logn) leads to the consistency of (-K'n, Z„, # n ) when 9* G 0(2) for all j. 

• Moreover, if r > 4 and b k , b k are twice differentiable satisfying \\db~l{9) / d9\\® = Oik' 1 ) 
and \\d 2 b k (9)/d9 2 \\ e = 0(/T 7 ) with 7 > 3/2 (the same for b k ), then v n = f3 n = sjn 
ensures the convergence (13.61) of t n and the CLT (13. 7h satisfied by 9 n (Tj) for all j (with 
9* G 0(4)). 
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5. Proofs of the main results. In the sequel C denotes a positive constant whom value 
may differ from one inequality to another. 

5.1. Proof of Proposition 1 2. 21 (i) It is clear that {X t , t < t*} exists and is causal, stationary 
with finite moments of order r (see [2]). Therefore, X is defined by induction as follows: 

(5.1) X t := M e * (X t _ 1; X t _ 2 , • - - )6 + /*; X t . 2 , ■ ■ ■ ), Vt G T/; j = 2, • • ■ K*. 

Thus, X t is independent of (£j)j>* an d ft suffices to prove (ii) which immediately leads 
existence of moments. 

(ii) Let us first consider the general case when A (fg, {6}) and A (M 9 , {9}) hold with 
(5^(9) < 1. As in [8 J we remark that 

P^tfM \\r 

Xt r < 



for t < t* v with Z tJ := M e *(0, 0, • ■ ■ )6 + fe*(0, 0, • • ■ ) for all j = 1, . . . , K*. Assume that 
there exists C r j > such that C r ,t = sup i<t \\Xi\\ r and let t G T*, then 

\X t - Z t>j | < \M e * (X t _!, • • • ) - M*. (0, 0, • • • ) | |£ t | + | (X f _!, • • • ) - (0, 0, • • • ) | . 

We obtain for all t, by independence of (£j)j>t and A^: 

||A 4 - Z t || r < HM^AVi, ■ ■ ■) - M e *(0, 0, ■ ■ Ollrlletllr + ||/<s*(*t-i, ■ ■ ■) - /e;(0,0,.-.)||r. 

Then, we have: 



\\M e ,{X t ^, ■■■)- M,.(0, 0, • • • )|| r < ocf\M rj ,e*)\\X t ^\\ r < C r , t otf\M 9p 9\ 

i=l i=l 
oo oo 

• • • ) - f *(O, 0, • • • )|| r < a\ \f e; ,e*)\\XU\r < C r , £ a?\f ep 6*). 

i=i i=i 

We deduce that 

/ oo oo 

||X t || r < \\Z t J r + C r , t ^«! 0) (/,;, {6*}) + (iE||eoir) 1/r J2 a< i° ] ^P WW 



j=i t=i 



Thus, ||A t || r < oo, C rjf+ i < oo and ||X t || r < \\Z t j\\ r + C rit +i(3^°\9*) since C r>i < Cy )t+ i. Sim- 
ilarly for any i < t, we have C rj , < C r> t+i and ||A^|| r < maxi<.,<x* {||Z tJ || r + C r)t +il3 ( ^\6*)^ . 
Thus, by definition of C r j+i = sup i<t \\X t \\ r we obtain 



< m^{\\Z t;j \\ r + C r , t+1 {3(°\9*)} , 



and the Proposition is established. 
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In the ARCH-type case when f e — and A (h e , {9}) holds with /3 (0) (6>) < 1, we follow the 
same reasoning than previously starting from the inequality 

\\X? - (M,.(0,0, • ■■)i t f\\ r/2 < ||^*pf t -i, • • •) - ^*(0,0, • • OMItf llr/a- 

Finally we obtain the desired result with 

\\M e * (0, 0, • • • ) Co + fe* (0, 0, • • • ) || r \\M e * (0, 0, ■ • ■ ) &|| r 
C = max n , n . t— ^ A max = — . ■ 

5.2. Some preliminary result. The following technical lemma is useful in the sequel: 

Lemma 5.1 Suppose that 9* e 0(r) /or j = 1, . . . , if* wii/i r > 2 and under the assumptions 
A (f e ,Q), A (Mq,Q) (or A (h$,Q)) and D(Q(r)), then there exists C > such that 

for all t el*, E( sup \q t {9) |) < C. 

Proof Using the inequality (a + fe) 2 < 2(a 2 + o 2 ), we have for all t G Z: 

Ut { r) < 2(lW-^ '-)lle(r) + llM°.-)||e W ) 

< 2((^af ) (/ e ,e(r))).^af ) (/,,e(r))|X^| 2 +||/ e (0,...)||^ ) 

i>l i>l 

therefore 



E IWIIe ( r) <2(c(^af(/,,e(r))) + ||/ fl (0, 



l9(r) 



Thus E||/ fl *||! (r) < C for all t e Z and similarly E(||/z* || 0(r) ) = E(||A/|||| (r) ) < C M . Yet, 

under assumption (£)(0(r))), we have: |?t(0)| < — | J^sT* — fg\ 2 + | log(/i|) | and using inequality 
logo; < x — 1 for all a; > 0, it follows: 



h 



\og(h*)\= log® + logM) <l + |log(/»)| + -/»*. 



Finally, we have for all t 6 Z: 



1 



E( sup < l + |log/i| + ^(E||^||e( r ) + 2E|X t | 2 + 2E||/ e 1| (r) ) < C. 



6>ee(r) 



5.3. Comparison with stationary solutions. In the following, we assume that 9* G B(r) for 
all j — 1, ... , if* with r > 1. It comes from [2] that the equation 

X t j = M e * ((X t -kj)kew*) • £t + fe* ({X t ^ kd ) ke]N *) for all t e Z 
has r order stationary solution (Jf t jJ t 2 for any j = 1, . . . , if*. Then 

Lemma 5.2 Assume that the assumptions Ao(fg,Q), Ao(Mg,Q) (or Ao(hg,Q)) hold and 
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1. X t = X tA for all t<t\; 

2. There exists C > such that for any j G {2, ■ ■ • , K*}, for all t G T* , 



\\x t -x t j r < tf( l<p mf t , {^\e*f-tuy P + J2ti°\e*)} 

J 1 i>p 



Proof 1. It is obvious from the definition of X. 
2. Let j G {2, • • • , K*}, we proceed by induction on t G T*. 

First consider the general case where Ao(fe,{9}) and Ao(Mg, {9}) hold with f3^\9) < 1. 
By Proposition 12.2} there exists C r > such that \\Xj — X^-\\ r / 2 < \\X t \\ r + \\X t j\\ r < 
C + maxi<j<^» H^ojllr < C r for all j = 1, . . . , K* and t G Z. For 1 < p < t — t*_ x let 
u e : = sup t *_ i+ ^<i< t » - Xjj|| r . Then ||X t - X tJ || r < u^t-r^J/p] and for any t <i <t*y. 

\\Xi — Xij\\ r < y~^/3 fc ° (9*)\\Xj_ k — Xi_ k j\\ r 

k>l 

< E 11^-* - *i- w iir + ci- E 

fc=l fc>p 

/c>p 

Similarly, it is easy to show that for all 1 < £ < [(t — ^_i)/p] we have 

k>p 

Denote a = (O) (0J) < 1, b = C r J2 k >pPk\ d j) such that u e < au ^ + b - Considering 
w = u and W\ = aw<_i + b, then W£ = a e w + 6(1 — a )/ (1 — a) < a e w + 6/(1 — a). Since 
wo < Cr by definition and U£ < we for any £, we have: 

«. < A. + ^ < (g'°>(q))'c r + 1 _ pf^) 



< 



T 3^t(" (0, (»;))' + E^ , (»;: 



Thus for all 1 < p < t - t*^ 

K - xh\\r/2 < Cr\\x t - x t j r < c rU[ ^ tu)/p] < c^^f-tu)/* + J2ti°\e*)) 

i>p 

and Lemma 15.21 is proved. 

In the ARCH-type case when f = and A (h e , {9}) holds with 0^(9) < 1, we follow 
the same reasoning than previously starting from the inequality 
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For all j = 1, ... , K* and t G Z, by Proposition E2J ||X 2 - Jf? J .|| r/2 < C r 2 and therefore 

^<^ (0) (^-i + C r 2 ^^ 0) (^) 

k>p 

for tt£ = sup t » i+ e p <i<t* — X^-\\ r / 2 and Lemma [5T21 is proved. 



5.4. The asymptotic behavior of the likelihood. For the process \Xt,j) teT * 
j G {1, • ■ ■ , if*} and s G T* denote: 

(X..-- ff' js2 

(5.2) 



for any 



with fg' J := fe(X s _ 1:j ,X s _ 2d , . . .), 
any T C T*, denote 



h s 9 ' j := {M s /) 2 where := M e (X s _ 1:j , X s _ 2j , ...). For 



L n ,j(T, 9) :=-~5>j(0) 



the likelihood of the j th stationary model computed on T. 
Lemma 5.3 Assume that the hypothesis D(Q(r)) holds. 

1. If the assumption H with r > 2 holds then for all j = 1, . . . , K* : 



71* 



\L n (Tj, 0) — L n j (T*, 6) 



9(r) 



0. 



2. For i = 1,2, if the assumption Hi with r > 4 holds then for all j — 1, ... , K* : 



n 



d i L n (T*,e) d i L nj (T*,e) 



de i 



0(r) 



0. 



1 2i 



Proof l-)Forany^Ge(r), ±L n (T*,e)-±L nd {T*,9) < — £ \qt*_ l+ k(0)-Q^_ 1+ kj 
Then: 



1 L n (T*,9) - ^L n>j (T*,9) 



n 



11 ': 



< 



e(r) n 



r) . 



j fe=i 



By Corollary 1 of Kounias [16J, with r < 4 and no loss of generality, it is sufficient that 



fc>i 



For any 6 9(r), we have: 

(5.3) - q. d (0)\ < pi*. - fe\ 2 \K - h?\ 

+ \(\X 2 s ~ XU + \fe - fS J \\fS + 17 + 2X S | + 2\f/\\X s - X 3 ,\ + \hi - h s A). 
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First consider the general case with A (fg, {8}) and A (M$, {8}) hold and (5^(8) < 1: 

UM ~ M*)lle(r) < C(l + \X S J + \X S \ 2 + \\f s e ' j \\e (r) + ||/J|||< r) ) 

x (\X S - X s>j \ + \\f° - f/\\ e(r) + \\h° e - h^\\ e(r) ), 

and by Cauchy-Schwartz Inequality, 

x E[(\X S - X. d \ + m - fe d h(r) + WK- ^||e W ) r/2 ] • 

Using Proposition (12.2ft and the argument of the proof of Lemma ( 15.11) we claim that 
E\X s \ r < C, E\\fe\\e(r) < C and that E\\f^\\ r e(r) < C. Thus: 

(5.4) {Ehs{e)-q s ,M\\tr)) 2 ^ (i^7 - I" /2 + 1 1 / S - /^'^ 1 1 e^) + 1 1 ^| - 1 1 - 
Since r/2 > 1, we will use the U^ 2 norm. By Lemma [5.21 

r/2 



\\X S - X s J r/2 <\\X S - X s J r < CM <k {^\8*) k /v + (Oj)} 



<C inf {^°\8*) k ^ + J2^i(^)}- 



(5.5) =}► E\X S -X S J' 2 < c( yi M k {^°\8* j ) k ^ + J2/ 3 i 0) ( 6 j)} 



Moreover, as (A (Mg, 0(r))) holds, we have: 

(5.6) \\\\hl -hf\\ e{r) \\ r/2 <C^r i ai \MeMr))\\X.-i-X.-< 



-1,3 Mr- 

i>l 



From (15. 6p we obtain: 

fe/2-l 

||||^-/^||e W l|r/2<c( ]T a?\M ,e(r))\\X.-i-X.- iJ \\ r +Y l e(r))||X s _-X s _ y 

i=l i>k/2 

For all s > t*_ x and 1 < i < k/2 — 1, then s — i > s — i > k/2 and by Lemma I5T21 

\\x s ^-x s . h3 \\ r < c inf {pv>(e*)Wp + (e;)} 

< C inf {/3 (0) (^) fe/(2p) + ^/3f ) (^)} 
Thus, we can find C > not depending on s such as: 

(5.7) E\\h s e -hr\\ r £ r) < c[jni • {/3 (0) (^) fe/(2p) + E^ 0) (^)}+ £ af }) (M,,e(r))) P/2 

P i>p i>fc/2 
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Similarly, we obtain: 

(5.8) E\\n-f S e j \\tr) <^( x< in f J/ 3(0) (^) fc/(2p) + E^ ( ° ) ^)}+ E *?\foMr)) 



L<p<fc/2 

i>V i>k/2 



r/2 



Relations (15. 4ft . ( 15.5ft . (15. 7ft et (15. 8ft give (the same inequality holds with hg replaced by Mg): 

[<p<k/2 



(5.9) 15 - qsMWtr) ^ C [U?l/2 {P {0) ( e *i) k/{2P) +E^^)} 

+ ( £ ai°U,e(r))) r/4 + ( E «! 0) (M e ,e(r)) Xr/4 

i>k/2 i>k/2 

By definition = kc* / log(fc) (< k/2 for large value of k) satisfies the relation 

J2(^) r/ \^°\9*)) rk/8uk <oc. 

k>l 

Choosing p = Uk in (15. 9p we obtain: 

E - ^<J s E (|) r/1 (/j<"(e*)) rt/s "> 

fc>i fe>i 

+E (£)"'( E A m («J>f +E E h m CA, e(r)) +Q f»(M„ e W) )) r/4 . 

fe>l i>M fc fe>l i>fc/2 

This bound is finite by assumption and the result follows by using Corollary 1 of [16] . 

In the ARCH-type case when f 9 = and A (hg, {9}) holds with 0^(6) < 1, we follow 
the same reasoning than previously remarking that (15.31) has the simplified form: 

\Q S (9) - q s ,M\ < ^X 2 s \h s e ~ K j \ + \\X 2 S - X 2 J + \\h° e - hf\. 

Then 

mW) - Qs,M\\tr)) 2 < ce[(\x? - xzj + h^\\ e{r) ) r/2 }. 



As \\\\h s e - /ig J ||e( r )|| r /2 <C^«, 1 '(he, 0(r))||X s 2 _- - X*_ itj \\ r / 2 we derive from LemmaE3 
JE hs(9)- qs ,(9)\\tr) < ^[( 1< % 2 {/3 (0) (^) /£/(2p) +E^° ) (^)}) r/4 +( E °FV»Mr)) 

P i>p i>k/2 

We easily conclude to the result by choosing p = Uk as above. 



2-) We detail the proof for one order derivation in the general case where Ao(fg, {9}) and 
A (Mg, {9}) hold with p<®(0) < 1. The proofs of the other cases follow the same reasoning. 
Let j e {1, • • • , K*} and z = 1, ■ • • , d, we have: 

^H <9L ra (r;,fl) aL n , 3 -(r;,fl) |i ^^ii g^+fc(g) gg^+^Cg) 11 
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By Corollary 1 of Kounias (1969), when r < 4 with no loss of generality, it suffices to show 

dqt*_ 1+ k(0) dqt*_ i+k j(0) r/4 

e(r), 



£(fr /4 * 



fc>i 



9ft 



9ft 



< oo. 



For any s > denote k = s — t*_ v For any 9 G G(r), we have: 
9g s (£) _ 2 (X a -fS) dfS _ (X s - fjy dhl + 1 9^ 



9ft 



9ft 



{h s e f 9ft h%d9 i 



9ft ^' 9ft (^')2 aft h sj d Q. ■ 

Thus, using |ai&iCi - CI2&2C2I < |oi — ci 2 1 1 &2 1 j c 2 j + |&i - &2||ai||c 2 | + \ci - c 2 | |ai| |&i|, 



9g s (#) 9 ?SJ (ft) 



9ft 



9ft 



<2 T2ll^-^||e W ll^-/^lle W 

0(r) \ft 



8/« 



9ft 



0(r) 



+ X (l^-^l + ll/|-/ e s ile W ) 



dfe' J 


1 

e(r) h 


dfl 


df e ' J 


d9i 


9ft 


9ft 



0(r) 



ll^s - /|||e(r)) 



+ F ll^-^lle W ll^-^lll( 



r) 



9ft 



9ft 



8(r) 



+j;(\Xs - X ad \ + m ~ fS J h(r)){\X. + X.j\ + \\fl + fe'%(r)) 



9ft 



dh s e 


dh? 


09 t 


9ft 



1 



So for all s > it holds: 

ndq s (9) dq s j{9)„ 



M ,\\Xs-n\\kr) + T 2\\K-h S e 3 \W) 

O(r) ri 



dh 



8,3 



39; 



1 

+ r 

0(r) ft 



6(r) 



9ft 9ft 



9ft 



QQ lle(r) 



< rfi+iY i 2 +i^ i 2 +iif s n 2 +llf s ' J 'll 2 +ll 9 ^ll 2 -ull^ll 2 +ll^ll 2 +11 II 2 ^ 

SC^l + |A s | + |A sJ | +||J e || ( r ) + ||J e lle(r)+||^-||e(r) + ll"^~lle(r) + ll^lle(r) + ll^~lle(r) y ' 
x (|X S - 1 + || / e s - /« ||e W + || K - h? ||e W + 1 1 



dfl df. 



dhl dh, 



9ft 9ft 



89i 89i Me W 

Since the processes admits finite moments of order r, by Cauchy-Schwartz Inequality: 

I 9/| W..r/2 m 1 1 dh% 9/l^' 



9ft 9ft ll0 M 



ir/2 

9ft ~ ~d0T"eir) 



As (A (M e , 0(r))) and (Ai(M^, 0(r))) hold necessarily in this case, with the arguments of 
the proof of 1-), for all s > t*_ 1: 



IE 



] dq s (9) dq sJ (9) U r/4 



an 



< C 
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r/4 



4\fe,e(r))) r/ \( £ 4\M ,e(r)f ' 



+ (E^ (o) ( M ^ ( r )) 

i>k/2 i>k/2 i>k/2 

Choosing p = Uk = kc* / \og(k), we show (as in proof of 1-) ) that: 



k>l 



E(f) r/4 ^ 



do* 



de 4 . 



G(r) 



< oo. 



5.5. Consistency when the breaks are known. When the breaks are known, we can chose 
v n = 1 for all n in the penalization of (13. 2 p as the penalization term does not matter at all. 

Proposition 5.1 For all j = 1,...,K*, under the assumptions of Lemma 15.31 1-) with 
v n = 1 for all n, if the assumption Id(Q(r)) holds then 

9 n {T*) ^ 9*. 



Proof Let us first give the following useful corollary of Lemma [5.31 
Corollary 5.1 %-) under the assumptions of Lemma \5.3\ 1-) we have: 



ii-) Under assumptions of Lemma \5.3\ 2-) we have: 



^> with CA9) = --lE{q 0j {9)). 

0(r) rwoo 2 



1 &L n {T. 



3 ' 



&Cj{6) 



11 ) 



39* 



89 i 



a. s.^ 

e(r) n->oo 



with 



3%{9) 
d9 i 



2 1 d9 i 



We conclude the proof of Proposition [oTTl using £j(9) — — -IE {qoj{9)) has a unique maximum 
in 9* (see [2]). From the almost sure convergence of the quasi-likelihood in i-) of Corollary 
15.11 it comes: 



9 n (T*) = Argmax —L n (T*, 9) 
eee(r) \ n j 



Proof of Corollary 15.11 Note that the proof of Lemma 15.31 can be repeated by replacing 
L n by the quasi-likelihood L n . Thus, we obtain for % = 0,1,2, 



(5.10) 
i-) Let j El, 



n ] 



d*L n (T*,9) &L 1hJ (T*,9) 



d9 i 



39* 



0. 



8(r) 



K* . From [2J, we have: 



-L n ,{Tl9) - C 3 {9) 



0(r) 



0. 



Using (15.101) . the convergence to the limit likelihood follows. 

ld l L nJ {T*,9) 3*^(9) 



ii-) From Lemma 4 and Theorem 1 of [2J, 

i n i l i_ r Ar- 1 nl\ 



39 i 



39* 



0(r) 



for 
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5.6. Proof of Theorem \3.1[ This proof is divided into two parts. In part (1) K* is assumed 

(t*,0*). In part (2), K* is unknown and we show 



to be known and we show {r_ n , 9 n ) 



-p 

K n — y K* which ends the proof of Theorem 13.11 



v 



Part (1). Assume that K* is known and denote for any t G Tk*'- 

k* K* 

T n (t) := J n (K*,t_,l n (t)) = -2J2J2^ fan T*,9 n (T k , 



fc=l j=l 

It comes that t n = Argmin ( I n (t) ) . We show that 9 n 



r* as it implies 9 n (T nj 



r 9* for all j = 1, • • • , K*. Without loss 

n— i>oo 



9 n (T*) — > and from Proposition 15. II 9„ (T, 

n— >oo 

of generality, assume that K* = 2 and let (u n ) be a sequence of positive integers satisfying 
u n — > oo, u n /n — > and for some < r\ < 1 

v v,u n = {teZ/ \t-t*\> rjn ; u n < t <n-u n }, 
W VtUn = { t G Z/ \t — t*\ > rjn ; < t < u n or n — u n < t < n }. 

Asymptotically, we have P(||r n - r*|| m > rj) ~ P(|f n - t*| > -qn). But 

P(|f n - ** | > nn) < Pfr„ g K,, Un ) + pfe g 



< Pf min (/ n (t) - < o) + Pf min (T n (t) - T n {t*)) < 

\tev v ,u n / \tew^,u„ 

we show with similar arguments that these two probabilities tend to 0. We only detail below 

the proof of P( min (I n (t) — /„(£*)) < ) — > for shortness. 

\tev v , u „ J 

Let t G V VjUn satisfying t* < t (with no loss of generality), then T x n T* = T*, T 2 fl T* = 
and T 2 fl T 2 * = T 2 . We decompose: 



(5.11) I n (t) - /„(**) = 2 (L„(T*, n (T*)) - L n (T*, 9 n {T t )) + n T 2 *, # n (T 2 *)) 

- L n (T\ n T 2 *, e n {T x )) + L n (T 2 , 9 n (T*)) - L n (T 2 , 9 n (T 2 )) 

As #Tj* = t*, fl T 2 *) = t — t*, #T 2 = n — t > u n , each term tends to oo with n. Using 

Proposition 15.11 and Corollary 15.11 we get the following convergence, uniformly on V VMn , 



9 n (T*) ^> 91, 9 n {T*) ^ 9\, 9 n {T 2 ) 

n— too 



a.: 
n— too 



9\ and 



L n (T*,9) 



n 



0(r) 



0. 



L n (TinT 2 *,0) 



i - i* 



L n (T 2 ,9) 



n — t 



MO) 



0(r) n— >oo 



0. 



0(r) n->oo 

For any e > 0, there exists an integer iVo such that for any n > No, 
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L n (Tx n T 2 *, n (T 2 *)) 



t - 1* 
Thus, for n > N , 



< 



e n — t 



n 



L n (T 2 ,9 n (T*)) - L n (T 2 ,9 n (T 2 )) 



n — t 



< 



r^D-rrA^m)) = rlCm - L »( T ;MT;)) + Ln^Mj^) _ L n (T^9 n (Ti)) 



n 



n 



n 



L n (T*,6 n (Ti)) 



n 



< e | L n (T*X(T*)) L n (T;,9 n (Ti)) | e 
~ 6 n n 6 



Then, 



(5.12) 



L n (T*X(T^)) L n (TtX{Ti)) 



n 



n 



Similarly, for n > N : 



(5.13) 2 ' 1 2j; - 2 V ;y >rz(£ 2 (fl 2 *) -£ 2 (fln(Ti))) 



n n 



Finally, for n > Nq, 
(5.14) 



L ra (T 2 ,g ra (r 2 *))-L n (r 2 ,g n (T 2 )) > _ £ 
n 6' 



and from (15. lip and inequalities (I5.12p . (15.13P and (I5.14p we obtain uniformly in t: 

/ » (/) > r ;fA(^) - A(^T!))) +^f£ 2 (^) - £ 2 (9 n (Ti))) -\e, n> N . 



n 



6 



Since 6* ^ 9 2 , let V%, V 2 be two open neighborhoods and disjoint of #* and 9 2 respectively, 

5 t := Inf [Ci{9*) - > for i = 1, 2, 

since the function # i— )■ £?(#) has a strict maximum in #* (see [HJ). With £ = min(r 1 *5i, i]5 2 ), 
we get 

. if fl B (T0 G Vi i.e. fl B (T0 G V 2 C , then J " (t) " ^ > ^ 2 - |e > |; 

. If e„(T0 £ Vi i.e. e„(T0 G Vf, then /n(t) ~ ^ > - ~£ > J- 

n oo 

In any case we prove that I n (t) — I n (t*) > -n for n > N and all t G V n% . . It implies that 

6 

pf min (T n (t)-T n (t*)) < o] — >0 and we show similarly p( min (T n (t) -T n (t*)) < o] — >0. 



\t€Wr, 



It follows directly that P(||r n - r*\\ m > rj) — >0 for all r] > 0. 



Part(2). Now K* is unknown. For K > 2, x = (x±, ■ ■ ■ , xk-i) G 1R k l ,y — (yi, ■ ■ ■ , Vk*-i) 
IR**- 1 , denote 

II s - 3/||o 



max min \xu — yA. 

l<j<K*-l l<k<K-l J 
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Lemma 5.4 Let K > 1, (t n ,9_ n ) obtained by the minimization of J n (t,6_) on Tk x &(r) K 
and z n = t n / n - Under assumptions of Theorem \3.1\ ||r n — r*||oo — >* if K > K* . 

n— >+oo 

Now we use the following Lemma [5.51 which is proved below (see also |18j): 

Lemma 5.5 Under the assumptions of Lemma \5.3\ i-), for any K > 2, there exists Ck > 
such as: 

K* K „ 

V(£,0) eT K x Q(rf, u n (t,9) = 2 ~ OW) ~ AW) > — II* ~f II- 

3=1 k=l 

Continue with the proof of Part(2) shared in two parts, i.e. we show that P(K n = K) — > 

n— ^+00 

for K < K* and K* < K < K max separately. In any case, we have 
P(K n = K) < p( inf (j n (K,t,6))<J n (K*,f,9*)) 

(5.15) < pf inf (J n (K,t,9)-J n (K*,t*,9*))<-(K*-K).). 

i-) For K < K\ we decompose J n (K,t,6) - J n (K*,t*,6*) = n(u n (t,6) + e n (t,6)) where 
u n is defined in Lemma 15.51 and 



e n (t_,6) = 

It comes from the relation (15.151) that: 



3=1 J k=l 3=1 KJ 



(5.16) P(K n = K)<p( inf (u n (t,9) + e n (t,e))<^ (K*-K)). 



n n [T.H) ■■: ( „\T.»)) S 

Corollary 15 . 1 1 ensures that e n (t,6_)) — > a.s. and uniformly on Tk x Q(r) K . By Lemma 
[531 there exists C K > such that u n (t,8) > C K \\t — f\[oo/n for all (t,9) G T K x 6(r) x . 
But, since K < K*, for any t G Fx, we have t*||oo/^ — 111— l*||oo > nuni<j<jf»(r* — 
r*_ 1 )/2 that is positive by assumption. Then u n (t,9) > for all (£, 0) G J-^ x 9(r)^ 
and since l/v n — > 0, we deduce from (I5.16P that P(K n = K) — > 0. 

n— ¥00 n— >oo 

ii-) Now let K* < K < K max . from (15. 16ft and the Markov Inequality we have: 

P(K n = K) < p(j n {KXln)-UK*,t*,9*) + -(K-K*)<0) 

< p(\j n (KXln)-MK*,f,e*)\>-) 

(5.17) < ^E\J n (KXln) ~ J n (K*,t*,9*)\. 

n 

Denote t n = (i n ,i, • • • ,t n ,K)- By Lemma E3J there exists some subset {kj , 1 < j < 
K* — 1} of {1, • • • , K — 1} such that for any j = 1, • • • , K* - 1, t n ^ k Jn -> r*. Denoting 
fco = and = K, we have: 

if* K 

J n (K,t n ln)-Jn(K*,f,e*) = 2 f V L n (T*, 0!) - V L n (f n>k , e n>k )) 



22 



J.-M. BARDET, W. KENGNE AND O. WINTENBERGER 



K* 



^2^L n (T*,9*) - ^2 L n (T nyk , B n , k ) 
fc=fcj_i+i 



and from (I5.17P we deduce that: 



2u 



K* 



P(K n = K) < -^J2 E \ L n(T*,9*)- Yl L n {T n>k ,e n , k ) 



3=1 



k=kj-\+l 



K* 



. V n * ^ . _ ^ ^ ^ 



3 =l J 



Since for any j — 1, • • • , K* — 1, it comes from Lemma [5.31 that 



-E 



71; 



Ln(T*,9*)— ^ L n (T ntk , 6> n> , 



fc=fcj_i + l 



and therefore P(K n = K) — y 0. ■ 
Proof of Lemma 15.51 Let K > 1 and consider the real function v define on x © by: 

f min [max(£,(0*) - CJ9), CA9*) - CAB'))] if B + &' 

V IQ Q<\ _ J l<j<K* L ^ JK 3> Jy ' JK 3> Jy >n 

\ if B = B'. 

The function v has positive values and v(9,9') = if and only if 9 = 9' since the function 
9 i — y Cj{9) has a strict maximum in 9* (see [II]). By Lemma 3.3 of [T7], there exists Cg* > 
such that for any (t, 9) 6 J 7 ^ x 0^ 



«(«*,^ >— lli-fuc 

n J n 



j=l k=l 

Moreover, for any j = 1, • • • , K* and 9 e 6, £j(#*) - £,(#) > v(0, 0*) and denoting C K = 
2Cg* the result follows immediately ■ 

5.7. Proof of Theorem \3.<H Assume with no loss of generality that K* = 2. Denote 
(u n ) n a sequence satisfying u n — >oo, u n /n — >0 and P(|t n — i*| > ttn) — )-0 (for example 



u n — n \> max(E|r„ — r*|, For 5 > 0, as we have 

P(|I„ - f I > 8) < ¥(S < \t n - t* | < U n ) + F{\t_ n -t*\ m > U r 



it suffices to show that lim lim P(<5 < \t n — t*\ < u n ) = 0. 
Denote V SiUn = { t e Z/ 5 < |t - t*| < u n }. Then, 

F(8 < \t n - t*\ < u n ) < Pf min (T n (t) - T n (t*)) < O). 

Let t e Vs tUn (for example t > t*). With the notation of the proof of Theorem 13. 1[ we have 
L n (T?,9 n (T?)) > L n {TtX{Ti)) and from (EUD we obtain: 



I n (t) - I n (t*) 



t - t* 



> 



t-t* 



l^ht;, ^T^-L^nT*, ^ n (T 1 ))+L n (r 2 , B n (T;))-L n (T 2 , B n (T 2 ))) . 



i-) We show that 
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t-t* 



L n (Ti n T 2 *, 9 n (T*)) - L n (T x n T*, 9 n {T x )) > for n large enough. 



Then ^1 = th^ + tzJL^^B) ^ _ t-T < «, ^ Q ^ 

n n t* n t — t* n n n->oo 



9 n (Ti) = Argmax I —L n (T x ,9) 

eee(r) 



n,6— too 



It comes that 



t - t* 



L n (Ti n T 2 ,9 n (T 2 *)) - L n (Ti fl T2, n (Tx))) converges a.s. and 



uniformly on V 5 , Un to £ 2 (0$) - C 2 {9\) > 

ii-) We show that — !— (L n (T 2 , 9 n (T 2 *)) -L n (T 2 , 9 n (T 2 )) 
t — t* V 



,,5— >oo 



0. For large value of n, we 



remark that 9 n {T 2 ) G O(r) so that 8L n (T 2 , 9 n {T 2 )) / 89 = 0. The mean value theorem 
on 8L n /d9i for any i = 1, . . . , d gives the existence of ni j G [6* n (T 2 ), #n(2~2*)] such that: 



(5.18) 



89,. 



8989, 



where for a,beR d , [a, b] = {(1-A)a+A6 ; A G [0, 1]}. Using the equalities L n (T 2 *. 
L n {T x n T 2 *, 9) + L n (T 2 , 9) and 8L n (T*, 9 n (T 2 *))/89 = 0, it comes from fl5TT8|) : 



dL n (7\ n T|, n (T 2 *)) <9 2 L n (T 2 , ft)f ) 



,(T 2 )) - 9 n (T*)), Vz 



and it follows: 



(5.19) 



1 0L n (TinT 2 *,0 n (T 2 *)) n-t 



-A n - (0 n (T 2 )-0 n (T 2 *)) 



with A r 



t-t* 89 

1 d 2 L n (T 2 A,) 
n — t 8989i / i<«<d 

1 8L n (Ti n T 2 , 9 n (T 2 *)) «... 8C 2 (9* 2 



t-t* 

. Corollary 15.11 ii-) gives that: 



and A n 



t - t* 
-El 



90 



n,<5— >oo 



89 







l„/9 2 g ,2(^: 



. Under assumption (Var), E^ — 2 ^ 

V ay 2 / 



V <90 2 

singular matrix (see [2]). Then, we deduce from (I5.19P that 



is a non- 



(5.20) 



^-t(6 n (T 2 )-9 n (T;)) ^ 0. 

V — V n,S— >oo 



We conclude by the Taylor expansion on L n that gives 
1 



t-t 



-\L n (T 2 ,9 n (T 2 )) - L n (T 2} 9 n (T 2 *))\ 



< 



1 

2(t-t*) 



\\9 n {T 2 ))-9 n {T*)\Y sup 



d 2 L n (T 2 , 
89 2 



— >• a.s. 
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5.8. Proof of Theorem^ First, (9 n (T j )-9*) = (9 n (fj)—9 n (T*)) + (? n (T/) - 6*) for any 
j G {1, ■ • ■ ,K*}. By Theorem 13.21 it comes tj — t* = op(log(n)). Using relation (I5.20p . we 

obtain: ^(fj) - 9 n {T*) = o P (^^). Hence, ^(d n (fj) - 9 n (T*)) -A and it suffices 



n 
v 



to show that ^Jri*(9 n (T*) - 6*) -A J\f d (0, F(9*)- 1 G(9*)F(9*)- 1 ) to conclude. 



For large value of n, 9 n (T*) e 6(r). By the mean value theorem, there exists (0 n ,fc)i<fc<<2 £ 
[6 n {T*),6*] such that 

(5.21) 9L n (TjX(TJ)) = dL n (TJ,9*) + ^.M ^ _ ^ 



/ 1 d 2 LJT*9 nk )\ 

Let F„ = -2(— ' M . By Lemma El and Corollary [EH F n ^ F(9*) 

\n* oOoOk / l<k<d n^<x J 

(where F{9*) is defined by (I3.8P ). But, under (Var), F{9*) is a non singular matrix (see [2]). 
Thus, for n large enough, F n is invertible and (I5.2ip gives 

,~ , s \ ,r 1 fdL n (T*6 n (T*)) dLJT*,9*' 



As in proof of Lemma 3 of [2], it is now easy to show that: 

1 dL n (T*, 9*) v 



ii j 89 »— x 



A^(0,C(^)) 



where G{9*) is given by flUD. Thus, since dL n (T*,9 n (T*))/d9 = 0, we have: 

i dL n (T*A(T;)) _ i / 3L n (r;A(r;)) a£ n (r;A(r;)h a . s . 

y^* <90 y^JV <90 (90 / »^ ' 

We conclude using Lemma I5U1 and the fact that l/y/n = 0{v n /n). ■ 
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